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(54) VIDEO CAMERA WITH BUILT-IN GEOMETRICAL CORRECTION FUNCTION 

(57)Abstract: 

PURPOSE: To provide the video camera from which a 
picture without distortion due to aberration of an image 
pickup lens is obtained. 

CONSTITUTION: A ROM 103 storing a color 
magnification aberration parameter of a lens is built in an 
image pickup lens 1 of the video camera. A CPU 102 
reads R, B magnification based on G in the parameter in ^ 
the replacement of lenses and the result is fed to a 
control circuit 8 through a lens side contact 101 and a 
camera side contact 9. R, B pictures are magnified or 
reduced by a reciprocal of the magnification. When the 
picture data magnified or reduced are not an integer, a 
microcomputer in the control circuit 8 calculates an 
interpolation weighted correction coefficient and the 
correction coefficient is stored in a RAM 1 1 . An 
arithmetic operation section 12 executes the product 
sum arithmetic operation of the coefficients, the result 
is stored in a buffer memory 13 and to a memory card 
15 via a memory card interface 14. 
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* NOTICES * 

JPO and NCtPl are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.*+** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The video camera characterized by having an operation means to amend the geometric 
distortion with said image pick-up lens, in the video camera which comes to have an image pick- 
up lens, the image sensor which changes into an electrical signal the photographic subject image 
by which image formation was carried out with this image pick-up lens, the analog-to-digital 
converter which changes the output signal of this image sensor into a digital signal, and the 
frame or field memory which stores temporarily the output of this analog-to-digital converter. 
[Claim 2] It is the video camera according to claim 1 which the geometric distortion of the lens 
to amend is the scale-factor aberration of a color, changes a signal into a chrominance signal, is 
equipped with the memory which memorizes this chrominance signal, and is characterized by 
said operation means performing expansion or contraction of an image so that a scale factor may 
be amended for every component of a color based on the output of this memory. 
[Claim 3] The video camera according to claim 1 which the geometric distortion of the lens to 
amend is the distortion of a lens, and amends this distortion. 

[Claim 4] The video camera according to claim 1 characterized by performing a geometric 
correction operation together with the operation of tetragonal-lattice-izing of a pixel pitch. 
[Claim 5] The video camera according to claim 2 characterized by carrying out by reducing the 
image of other colors on the basis of the image of a color with which the minimum image is 
obtained in the operation which amends the scale factor of a color. 

[Claim 6] The video camera according to claim 2 characterized by carrying out by expanding the 
image of other colors on the basis of the image of a color with which the greatest image is 
obtained in the operation which amends the scale factor of a color. 

[Claim 7] The video camera characterized by to have a means record the information showing 
the geometric distortion of said image pick-^up lens on a video signal, a common record medium, 
or a different record medium from a video signal in the video camera of record functional one 
apparatus which has a means to change and record the output signal of an image pick-up lens, 
the image sensor which changes into an electrical signal the photographic subject image by 
which image formation was carried out with this image pick-up lens, and this image sensor on a 
video signal. 

[Claim 8] It is the video camera which superimposes the information showing the geometric 
distortion of said image pick-up lens on a video signal in an image pick-up lens, the image sensor 
which changes into an electrical signal the photographic subject image by which image formation 
was carried out with this image pick-up lens, and the video camera which has a means to change 
and record the output signal of this image sensor on a video signal, or is characterized by 
equipping a video signal with a means to output independently. 

[Claim 9] The camera system characterized by to equip this image pick-up lens with a means 
calculate and generate a means memorize the information showing the geometric distortion of a 
photographic subject image by which image formation is carried out from this image pick-up lens, 
and said memorized information and the information which expresses distortion from the 
condition of a camera, and a means read the information in a camera side, in the camera system 
for which an image pick-up lens is exchangeable. 
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[Claim 10] Claims 2 or 7 characterized by delivering information the information showing the 
color which makes criteria information on the scale factor of the color of one interchangeable 
lens as a scale factor of the image of other colors to the image of the color, or a video camera 
given in eight. 

[Claim 11] It is a video camera claims 2 or 7 characterized by not transmitting information on the 
scale factor of the color of one interchangeable lens about the color made into criteria, but 
transmitting only the scale factor of the image of other colors and the information on a color 
over the color, or given in eight. j 

[Claim 12] The video camera according to claim 7 with which information on geometric distortion 
transmitted or recorded is characterized by being the distortion of an image pick-up lens. 



[Translation donej 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the original 
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2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] Especially this invention relates to the video camera equipment which 
amends the aberration of an image pick-up lens and acquired the high-definition image about an 
image pick-up and its signal-processing means. 
[0002] 

[Description of the Prior Art] Conventionally, in order to obtain a high-definition image in the 
image pick-up by the video camera, the engine performance of an image pick-up lens which 
carries out image formation to the image sensor other than densification, such as an image 
sensor, for example, a CCD image sensor etc., and high-performance-izing of subsequent signal 
processing was also made important, and the lens with which only the Image quality 
corresponding to subsequent photo electric conversion and signal processing is acquired has 
been called for. That is, the lens with which balance was able to take each aberration of a lens 
below on fixed level has been needed. 

[0003] However, it is impossible to remove geometric distortion called distortion with the wide 
lens of a short focus especially, and it has become that to which the image obtained was also 
distorted. Moreover, comparatively, in order to make all the aberration below into fixed level also 
in the lens of a long focus, the number of sheets of a lens increases, a configuration becomes 
complicated, or it has become the heavy thing which also has large magnitude. 
[0004] Moreover, in the field of an image processing, although the technique of obtaining the 
image which does not have distortion by the image processing for measurement etc. is reported, 
it is not based on the calculating machine for a general-purpose image processing, and does not 
necessarily realize easily with the video camera itself. 
[0005] 

[Problem(s) to be Solved by the Invention] This invention was made in view of such a 
conventional trouble, and it aims at offering the video camera equipped with the image pick-up 
means with which the image which does not have distortion as a whole was obtained, and its 
signal-processing means about geometric distortion among the aberration of an image pick-up 
lens, allowing this as a lens simple substance. 
[0006] 

[Means for Solving the Problem] The image sensor from which this invention video camera 
changes into an electrical signal the photographic subject image by which image formation was 
carried out with the image pick-up lens and this image pick-up lens. In the video camera which 
comes to have the analog-to-digital converter which changes the output signal of this image 
sensor into a digital signal, and the frame or field memory which stores temporarily the output of 
this analog-to-digital converter It is characterized by having an operation means to amend the 
geometric distortion of the scale-factor aberration of a color, distortion, etc. with said image 
pick-up lens. In the case of the scale-factor aberration of a color, the geometric distortion of 
the lens to amend changes a signal into a chrominance signal, and is equipped with the memory 
which memorizes this chrominance signal, and based on the output of this memory, said 
operation means performs expansion or contraction of an image so that a scale factor may be 
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amended for every component of a color. 
[0007] 

[Example] Hereafter, the example which applied this invention is explained based on drawing 1 
thru/or drawin g 3 . Drawing 1 shows the example applied to the electronic "still" camera 
recorded on a memory card. In drawin g 1 , the light of blue and red is alternatively reflected by 
reflectors 201 and 202 by color-separation prism, and an image pick-up lens (henceforth a lens) 
with exchangeable 1 and 2 are separated [ the color of them ] and picturized by image sensors 
301. 302, and 303 at B (blue), G (green), and R (red). Sample hold of the signal read from said 
image sensors 301-303 is carried out in the sample hold circuit 4, and it is changed into a digital 
signal in the A/D-conversion circuit 5. Signal processing, such as a white balance and a gamma 
correction, is made by the digital disposal circuit 6, and said digital signal is memorized by a 
frame memory or the field memory 7 for every color component the back. 
[0008] Moreover, 8 is the control circuit of the whole video camera, this control circuit 8 
performs the lens control CPU 102 and a communication link through the contact 9 for a 
communication link in a camera (camera side contact), and the contact 101 for a communication 
link (lens side contact) prepared in the lens 1. consequently this lens control CPU 102 performs 
control of a lens diaphragm mechanical component (not shown) etc. 

[0009] The information on a color that 103 is ROM the scale-factor aberration parameter of the 
color of a lens is remembered to be, for example, the magnitude of an image serves as max. and 
the scale-factor information on other color components are memorized. And when the power 
source of the time of lens exchange or a camera is switched on, the scale-factor aberration 
parameter of a color is read by said lens control CPU 102, lets said camera lens secret 
communication trust contact 101 and said camera secret communication trust contact 9 pass, 
and is sent to the control circuit 8 of said whole camera. For example, the scale factors Kr and 
Kb of R and B are read on the basis of G. In addition, both scale factors are represented with K 
by the following explanation. 

[0010] And only the inverse number of said read scale factor K expands or reduces the image of 
R and B. The core of this expansion or contraction is the optical axis of a lens, and if the 
address on said frame memory 7 of the image corresponding to an optical axis shall be set to (0, 
0) and the pixel of the address (u, v) shall become the address of (x, y) by expansion or 
contraction, it will serve as relation of u=Kxv=Ky, 

[001 1] Although what is necessary is just to replace by the image data of if the front types u and 
V are integers (u, v) when asking for the data P of (x, y) of the expanded image, when it is not an 
integer, there is the need for interpolation. As the approach of interpolation, if for example, a 3rd 
tatami lump interpolation method ("image-analysis handbook" January 17. 1991 first edition, 
October 15, 1991 2nd **, University of Tokyo Press issue, Mikio Takagi, and Akihisa Shimoda 
editorial supervision, 443 pages) is used The added sum-of-products operation to which weight 
is applied to the image data of the station of PI 1-P44 16 perimeters of the address (u, v) of the 
data P of an image to interpolate as shown in drawing 4 is needed, 

[0012] In order to perform this sum-of-products operation, it has the frame memory control 
circuit 10 which accesses data from said frame memory 7. The multiplier of weighting is 
calculated with the microcomputer in said control circuit 8, and is sent to RAM1 1 holding a 
multiplier. 12 is the operation part which performs the sum-of-products operation of this held 
multiplier, and the result calculated by this operation part 12 is recorded on a memory card 15 
through the memory card interface (I/F) 14. after being held at buffer memory 13. 
[0013] Under the present circumstances, if scale-factor aberration of a color is amended on the 
basis of the color component by which image formation was carried out to the magnitude of the 
greatest image, since other color components are expanded, they do not break off. [ of an 
image ] Moreover, if scale-factor aberration of a color is amended on the basis of the color 
component by which image formation was carried out to the magnitude of the minimum image, 
the image of the largest range can be obtained, moreover, the system of lens exchange — 
setting — etc. — if always based on one color, the information on the color used as said criteria 
does not have the need, and there will be little information to tell and it will end. 
[0014] Next, when amending distortion (distortion) of a lens, as an amendment algorithm, the 
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approach shown in Shingaku Giho's (PRU 91-1 13) "geometric correction method of the image 
which positioning does not need" (Onodera Yasuhiro, Ken-ichi Kaneya) can be adopted, for 
example. According to this approach, the new address is expressed by u=x+Ax3+Bxy2 v=y+Cx2 
y+Dy3 using the same address as the above, and since this is not necessarily an integral value, a 
value can be calculated with interpolation interpolation like the above. In said formula, in 
A=B=C=D, distortion does not exist, but A and D express amendment which is expanded in a x 
axis and the direction of the y-axis nonlinear, respectively, and B and C express amendment 
which gives a deflection to the symmetry about a x axis and the y-axis, respectively. 
[0015] If it asks as A=D and B=C in distortion of axial symmetry like a lens, the distortion of a 
lens can be amended easily. This interpolation operation may be performed by the operation part 
of dedication, and you may carry out by the program on the microcomputer which controls the 
whole camera. 

[0016] By the way. although the pixel pitches of an image sensor are length and width and are 
not equal in many cases, by the still picture data for image processings, this pitch is treated as 
an equal in many cases. It is necessary to interpolate the data sampled with the image sensor 
which whose pixel pitches are length and width and has the anisotropy which is not equal, and to 
change into the data of the tetragonal lattice which made the pitch in every direction equal as 
still picture data of such a processor. 

[0017] When it builds this function in a camera, it can calculate at once combining the 
amendment operation of said geometric distortion. Now, as for saying [ tetragonal-lattice-izing 
this, supposing it is m times the length ], the pitch of an image sensor means that width expands 
an image by m times in a longitudinal direction. Expansion or contraction of the image at the time 
of amendment of the scale-factor aberration of this processing and said color can be performed 
to coincidence. That is, the operation time can be shortened by performing each separately that 
what is necessary is to perform 1/K time perpendicularly and just to perform m/K twice as many 
expansion as this horizontally. Although this example took the configuration which performs 
geometric correction within a camera, it explains an example in case only record or an output 
makes amendment information below, 

[0018] Drawing 2 is the example of a video camera equipped with a means to record the 
information showing the geometric distortion of an image pick-up lens on a different record 
medium from a video signal, in the video camera of record functional one apparatus. In drawing 
2 , it is color-separation prism, and the light of blue and red is alternatively reflected by 
reflectors 201 and 202, the color is separated into B. G, and R by image sensors 301, 302, and 
303, and image formation of an image pick-up lens with exchangeable 1 and 2 is carried out to 
them. Sample hold of the signal read from said image sensors 301-303 is carried out in the 
sample hold circuit 4, and it is changed into a digital signal in the A/D-conversion circuit 5. and 
further, signal processing, such as a white balance and a gamma correction, is made by the 
digital disposal circuit 6, and it is changed into a color-difference signal in a matrix circuit 16. 
[0019] 17 is the VTR section which carries out the digital storage of the acquired video signal, 
an error correction sign (ECO) is added in the EGG encoder 171, record modulation-code-ization 
which was suitable for the following magnetic tape record in the record modulation-code-ized 
circuit 172 is performed, and is amplified with the record amplifier 173, and is recorded on a 
magnetic tape 1 74. 

[0020] On the other hand, 8 is the control circuit of the whole record functional one apparatus 
video camera, this control circuit 8 performs the lens control CPU 102 and a communication link 
through the contact 9 for a communication link in a camera, and the contact 101 for a 
communication link prepared in the lens 1, consequisntly this CPU102 for lens control performs 
control of a lens diaphragm mechanical component (not shown) etc. 

[0021] 103 is ROM the parameter which amends the distortion of a lens 1 is remembered to be, 
and the correction factor (A, B. 0, D) of the inverse transformation shown in the Shingaku Giho's 
(PRU 91-113) "geometric correction method of the image which positioning does not need" is 
memorized like the example shown in said draw ing 1 . And when the power source of the time of 
lens exchange or a camera is switched on, said correction factor is read by control CPU 102, 
lets the camera lens secret communication trust contact 101 and the camera secret 
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communication trust contact 9 pass, and is sent to the control circuit 8 of the whole camera. 
[0022] Said control circuit 8 records the correction factor of the lens currently used for 
photography, and the time code of the beginning for which the lens was used, and the last on the 
IC memory card 19 from the memory card interface (I/F) 18. 

[0023] In order to amend distortion of an image at the time of playback, read an image by one 
frame and the correction factor (A-D) corresponding to the time code is read from said IC 
memory card 19. The image coordinate (u, v) amended from the image address and a correction 
factor by the numerical calculation shown in the above "the geometric amendment approach of 
the image which positioning does not need" is searched for. By said interpolation, the image data 
of the address of an amendment image is interpolated by the image data of a nearby image 
coordinate to numerical calculation, and is obtained. 

[0024] Next, drawing 3 shows the example of the video camera which outputs the information 
showing the geometric distortion of an image pick-up lens with an output means different from a 
video signal in the video camera which outputs a video signal. In drawing 3 . from reflectors 201 
and 202, it is color-separation prism, and the light of blue and red is reflected alternatively, the 
color is separated into B. G. and R by image sensors 301, 302, and 303. and image formation of 
an image pick-up lens with exchangeable 1 and 2 is carried out to them. Sample hold of the 
signal read from said image sensors 301-303 is carried out in the sample hold circuit 4, it is 
changed into a digital signal in the A/D-conversion circuit 5, and signal processing, such as a 
white balance and a gamma correction, is made by the digital disposal circuit 6, it is changed into 
a color-difference signal in a matrix circuit 16, and a digital output is carried out by the digital 
output I/F section 20. 

[0025] On the other hand. 8 is the control circuit of the whole record functional one apparatus 
video camera, this control circuit 8 performs the lens control CPU 102 and a communication link 
through the contact 9 for a communication link in MAMERA, and the contact 101 for a 
communication link prepared in the lens 1. consequently this CPU102 for lens control performs 
control of a lens diaphragm mechanical component (not shown) etc, 

[0026] 103 is ROM the parameter which amends the distortion of a lens 1 is remembered to be, 
and the correction factor (A, B, C, D) of the inverse transformation shown in the Shingaku Giho's 
(PRU 91-113) "geometric correction method of the image which positioning does not need" is 
memorized like the example shown in said drawing 1 . And when the power source of the time of 
lens exchange or a camera is switched on, said correction factor is read by control CPU 102, 
lets the camera lens secret communication trust contact 101 and the camera secret 
communication trust contact 9 pass, and is sent to the control circuit 8 of the whole camera, the 
place which this point changes with the example of said drawing 2 — 7 — it is — ** 
[0027] 21 outputs the correction factor of the lens currently used for photography to an external 
control equipment, when there is a demand which is camera-control I/F for controlling a video 
camera from the exterior, and outputs a correction factor from an external control equipment. 
[0028] A computer can be made to read an image pick-up image and its image-distortion 
correction factor by having an image memory and said means of communications for such a 
video camera, and connecting with the computer which had the amendment operation of said 
image distortion programmed, and even if it uses a lens with an image distortion, it becomes 
possible to obtain the image which does not have distortion by the amendment program of said 
image distortion. 

[0029] By the way, when using a zoom lens as an interchangeable lens, the chromatic aberration 
of said distortion and scale factor etc. changes with the focal distances of a lens in many cases. 
In such a case, said ROM103 is made to memorize the amendment data for every focal distance 
as a table, focal distance information can be read to the lens control CPU 102 with an encoder, 
and corresponding amendment data can be sent to the body of a camera. 
[0030] 

[Effect of the Invention] By building an operation means to amend the geometric distortion with 
a lens in a video camera, it also becomes possible to remove a part of constraint which could 
amend automatically the distortion of a wide lens and the chromatic aberration of a scale factor, 
and was imposed on the lens design by such function, and this invention can offer the video 
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camera equipment using a cheap lens by the small light weight. 

[0031] Moreover, it is the video camera for which an image pick-up lens is exchangeable, and 
has in a lens by making information showing the geometric distortion of a lens into a parameter, 
and when a video camera performs this information together with the operation of the geometric 
distortion amendment suitable for the lens with which it was equipped based on the information 
read and read in the case of lens wearing etc., an interchangeable lens type video camera can 
also acquire said effectiveness. 

[0032] Furthermore, in the video camera which calculates tetragonal lattice-ization of a pixel 
pitch, improvement in the speed of processing can be attained by carrying out together with the 
operation of geometric distortion amendment. By recording the parameter about the geometric 
distortion with a lens with image data in the video camera of record functional one apparatus 
which records the information on geometric distortion amendment with a video signal, same 
amendment in the camera exterior can be performed and said same effectiveness is acquired as 
a system. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation n^ay not reflect the original 
precisely. 

2 **** shows the word which can not be transiatea. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[rSttth^btcK r;"am of tKe 1st »xa™,e of this invention. 



[Description of NotationsJ 

1 Image Pick-up Lens 

2 Color^Separation Prism 
301 , 302, 303 Image sensor 

4 Sample Hold Circuit 

5 A/D-Conversion Circuit 

6 Digital Disposal Circuit 

7 Frame Memory 

8 Camera Control Section 

9 Camera Side Contact 

10 Frame Memory Control Section 

11 RAM 

1 2 Multiplier Operation Part 
15 Memory Card 

101 Lens Side Contact 

102 Lens Control CPU 

103 ROM 



[Translation done.] 
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